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evidence-based practices and programs? 


Howard Goldstein'* & Lesley Olswang” 
'Department of Communication Sciences and Disorders, University of South Florida, Tampa, FL, USA; 
?Department of Speech and Hearing Sciences, University of Washington, Seattle, WA, USA 


Abstract 

Funding agencies, such as National Institutes of Health and the Institute of Education Science have 
recognized the need to improve the uptake of empirically supported practices into everyday service delivery 
in real-world settings. Implementation Science is a new discipline that seeks to remedy this problem through 
careful investigation using traditional and new research methods. We begin this Special Issue on Implemen- 
tation Science with some of the definitions forwarded to help us understand the distinction among different 
types of research that are fundamental to Implementation Science. This introductory article discusses some 
of the traditional assumptions that have been called into question by this new discipline. We then outline 
some of the highlights of the four subsequent articles in this issue. The final section of this paper 
summarizes some of the ideas that are likely to shape the future of research that promises to advance 
evidence-based communication intervention practices. 
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tation Science is defined as a field of study 
that investigates methods to promote the 


This special issue on Implementation 
Science as it relates to communication 


assessment and intervention reflects grow- 
ing awareness of the challenges in gaining 
acceptance and achieving widespread 
implementation of high-quality services 
and programs in real-life contexts. This 
preface seeks to highlight needs that exist 
and the changes we foresee for addressing 
those needs from two perspectives: those 
of the authors who have contributed to 
this special issue and the discipline of 
Implementation Science more generally. 
Despite the growing popularity of terms 
like dissemination and implementation (D & 1), 
the terminology remains murky. Implemen- 
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integration of research findings and evi- 
dence into policy and practice in systems 
such as health care or educational organiza- 
tions. Implementation Science is meant to 
subsume dissemination and implementa- 
tion research. Glasgow et al. (2012) offer 
definitions from an NIH perspective. 


Dissemination research is the scientific study 
of targeted distribution of information 
and intervention materials to a specific 
public health or clinical practice audience. 
The intent is to spread knowledge and 
the associated evidence-based interven- 
tions. The active process of dissemination 
is distinguished from the more passive 
process of “naturalistic” diffusion that 
occurs without concerted promotion. 


Implementation research is the scientific 
study of the use of strategies to adopt and 
integrate evidence-based interventions 
into clinical and community settings to 
improve patient outcomes and _ benefit 
population health. 
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Effectiveness research is similar to dissemi- 
nation and implementation research in its 
emphasis on adaptation and testing in 
real-world settings and with diverse pop- 
ulations, but it does not explicitly focus 
on understanding the spread and adop- 
tion of these intervention strategies. 


As Glasgow et al. (2012) point out that these 
types of research are much stronger in tan- 
dem than in isolation. In fact, we would 
argue that even efficacy research, which is 
not necessarily conducted in real-world set- 
tings, would be strengthened by anticipating 
and considering issues that relate to dissemi- 
nation and implementation processes. 


TRADITIONAL ASSUMPTIONS 


Some may question whether there is a 
science of implementation. Rather, it is safe 
to say that it is a fledgling science that 
arguably got its start at the beginning of 
the twenty-first century, despite many 
researchers who wrote about related topics 
long before that (e.g. Rogers, 1962; Wolf, 
1978). The journal, Implementation Science, 
began publishing in 2005. The seminal 
review of implementation research pub- 
lished by Fixsen, Naoom, Blase, and Fried- 
man (2005) is comprised largely of research 
published since 2000. The advent of Imple- 
mentation Science seems to stem from the 
questioning of a number of traditional 
assumptions in the scientific community. 
First, one could argue that Implementa- 
tion Science developed as a response to the 
failed assumption that the traditional research 
pipeline would lead to implementation of 
evidence-based practices. The assumption 
was that basic research would generate a 
knowledge base that would lead to clinical 
or education research focusing on efficacy 
and eventually effectiveness, and_ that 
research would lead to changes in clinical 
and community practice. Thus, we would 
expect evidence-based practices to have a 


genesis in research that might not be 
focused on application, but would ulti- 
mately be manifested in improved health 
and educational outcomes. Various models 
of how this might come about and what 
types of research are suited to different 
steps in this process have long been debated 
(e.g. Goldstein, 1990; Robey, 2004; Stokes, 
1997). It is fair to say that this traditional 
research pipeline is exceedingly long and 
perhaps with too many holes to produce 
solutions to our clients’ communication 
challenges and our clinicians’ practice needs 
in a timely manner (Green, Ottoson, Gar- 
cia, & Hiatt, 2009). Schliep, Alonzo, and 
Morris (2017) make this point, noting “that 
after 17 years, only 14% of healthcare 
research was adopted into day-to-day clini- 
cal practice following the traditional clinical 
research pipeline (Balas & Boren, 2000).” 

A second assumption is that evidence- 
based practices exist and our shortcoming is 
the failure to get them implemented. Two 
fundamental challenges disrupt _ this 
assumption. The first is that calls for 
expanding production of efficacy research 
in the discipline of Communication 
Sciences and Disorders only predate the 
call for implementation research by a few 
decades (e.g. Goldstein, 1990). One of the 
concerns expressed by scientists is that per- 
haps this focus on Implementation Science 
will detract from the need to produce 
much needed, high-quality _ efficacy 
research in the field. The second challenge 
is that evidence-based practices are not sta- 
tic. We should expect evidence and evi- 
dence-based practices to evolve and be 
refined with further research and imple- 
mentation. We need to acknowledge that 
a healthy system of service delivery must 
accept and advocate for a dynamic, con- 
stantly changing discipline. Evidence-based 
practices and their implementation will 
not proceed one practice or test at a time. 
For continual improvement in procedures 
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and policies to address communication 
disorders to progress with the urgency 
needed, a growing effort to produce effi- 
cacy research coupled with dissemination 
and implementation research is needed. 

The third assumption is that robust inter- 
ventions will change the behavior of the vast 
majority of individuals with communica- 
tion disorders for whom the interventions 
are designed, as well as those responsible 
for implementing those practices. This 
assumes more homogeneity in consumers 
(be they clients, service providers, adminis- 
trators, policy-makers, or other stakehold- 
ers) than is warranted. We need to 
understand the conditions under which 
interventions are effective. For example, 
scientific studies may show that interven- 
tions have applicability to more clients 
than originally expected; likewise, we may 
learn that individual participant character- 
istics indicate with whom interventions are 
less effective. Investigators also may learn 
that a host of contextual factors influence 
when and under what contexts robust 
interventions are effective and ineffective. 
Thus, adaptations to evidence-based prac- 
tices may need to respond to differences in 
clients, settings, tasks, dosage, as well as 
other refinements. Adaptations in practices 
may compete with the need to implement 
with fidelity. Scientific study is needed to 
sort out what variations are most effective. 
Overall, this third assumption seems to 
ignore the state of our clinical science as 
well as Implementation Science. 

Fourth, we assume that the success of 
evidence-based practices once well-imple- 
mented will enjoy sustainability because the 
success of clients will reinforce the contin- 
ued implementation of those practices. The 
literature on professional development has 
long recognized that clinician’s knowledge 
of effective interventions is not sufficient. 
Modeling, scaffolded practice and/or 
feedback are typically needed to prepare 


clinicians to implement with appropriate 
fidelity; even then, their organizations must 
support changes in procedures and policies 
within their service delivery systems for 
changes to be sustained. The assumption of 
sustainability ignores the many organiza- 
tional factors and external contingencies 
that can impinge on practices and policies 
in real-world settings. 

These are among the issues that moti- 
vated the articles contributed to this special 
issue on Implementation Science. Each of 
the articles previewed below offer perspec- 
tives on ways to move the field forward as 
we strive to develop, evaluate, and imple- 
ment evidence-based practices in commu- 
nication assessment and intervention. 


PREVIEW OF ARTICLES 


Olswang and Goldstein (2017) discuss the 
benefits and challenges of establishing 
researcher-stakeholder collaborations. They 
argue that such collaborations will have 
benefits for advancing science as well as 
practice. Stakeholders help ensure that 
research undertaken has relevance to prac- 
tical problems. However, researchers who 
are seeking to solve practical problems can 
capitalize on their efforts to help us under- 
stand mechanisms underlying behavior 
change. This seems to be consistent with 
what Stokes (1997) refers to as “use-in- 
spired basic research.” This notion of gen- 
erating fundamental understanding while 
addressing practical problems applies as 
well to advancing the science of imple- 
mentation as we seek to identify factors 
that facilitate and impede implementation, 
acceptance, and maintenance. Olswang 
and Goldstein highlight the potential of 
partnerships that include scientific clini- 
cians and clinical scientists who together 
can engender a stimulating environment 
of inquisitiveness and practicality. 
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Campbell and Douglas (2017) discuss 
the challenges of getting practitioners to 
adopt and implement evidence-based prac- 
tices. They argue that Implementation 
Science can inform those processes, espe- 
cially if interactive approaches are used to 
overcome the ineffectiveness of passive 
implementation strategies, such as didactic 
educational sessions. Interactive imple- 
mentation strategies found to be effective 
include audit and feedback, educational 
outreach, and reminders. Campbell and 
Douglas draw upon Cochrane Effective 
Practice and Organization of Care Group’s 
reviews of the literature. They highlight 19 
implementation strategies characterized as 
involving (a) evaluating and monitoring 
the quality of services, (b) educating clini- 
cians or patients, and (c) planning or 
preparing for practice change. How best to 
conceptualize these strategies and package 
them in effective ways to optimize imple- 
mentation efforts represents a future 
research need of Implementation Science. 
A key feature of these interactive 
approaches is that they seek to establish 
new expectations within organizational 
systems through information — sharing, 
prompting, and feedback that reflect new 
“norms” for sustaining effective practices 
in real-world settings. 

Schliep et al. (2017) acquaint readers 
with innovative research designs and 
methods that represent advances in imple- 
mentation research. Pragmatic designs, 
hybrid designs, qualitative methods, and 
mixed methods go beyond the standard 
designs used to study efficacy and effec- 
tiveness, such as randomized control trials. 
These research approaches hold promise in 
helping us develop an understanding of 
implementation processes that address bar- 
riers and facilitators to adoption by provi- 
ders and organizational systems. The 
authors discuss many of the variations and 
other considerations of these designs and 


methods in the context of the RE-AIM 
Implementation Science framework (i.e. 
Reach, Effectiveness, Adoption, Implemen- 
tation, and Maintenance). Schliep et al. 
provide illustrations of these variations 
using hypothetical cases of implementation 
of a swallowing screening protocol in a 
healthcare setting and a literacy interven- 
tion in an educational setting. 

The final paper by Kincaid and Horner 
(2017) draws upon their extensive experi- 
ence in scaling up an evidence-based edu- 
cational intervention (i.e. school-wide 
Positive Behavior Interventions and Sup- 
ports—PBIS) in over 23,000 schools across 
the U.S. They highlight the importance of 
Implementation Science for scaling up 
PBIS and offer lessons learned that might 
be applied to scaling up other innovative 
communication assessment and interven- 
tion approaches. Over the past few dec- 
ades they have learned that sustaining 
significant educational outcomes takes 
more than effective innovations and effec- 
tive implementation with high fidelity; it 
also requires enabling contexts that pre- 
dict where PBIS will succeed. Leadership 
teams need to be established that manage 
systems issues (e.g. funding, political reali- 
ties, dissemination, policy alignment) as 
well as practical issues (e.g. professional 
development, evaluation and performance 
feedback, and content expertise). Perhaps 
the most illuminating lesson for Imple- 
mentation Science is questioning the 
assumption of a “tipping point,” where 
social systems change is sustained through 
momentum. Kincaid and Horner argue 
that the complexities of educational sys- 
tems at school, district, and state levels 
call for constant vigilance to adapt to their 
ever-changing nature. This is because 
numerous internal and external factors 
can threaten implementation and sustain- 
ability even in the face of compelling 
outcome data. 
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ACKNOWLEDGING REALTIES OF 
IMPLEMENTATION 


The evidence-based practice movements 
within health care and education have 
been responding, at least in part, to the 
call for greater accountability and cost-ef- 
fective services. Perhaps this motivation 
has resulted in an overemphasis on evalu- 
ating existing intervention protocols. This 
may be shortchanging the scientific pro- 
cess. Scientific progress might best be 
served through a process of iterative devel- 
opment and evaluation of communication 
interventions to maximize their effects. 
From this perspective, one could argue 
that too many resources have gone into 
prematurely using randomized control tri- 
als to compare interventions that have not 
been adequately developed and refined 
through careful research. 

A recognition that evidence and evi- 
dence-based practices are not static phe- 
nomena is needed to advance our science. 
Perhaps researcher-stakeholder collabora- 
tions will inform the process of improving 
practices and developing new, more 
effective practices. This evolution of evi- 
dence-based practices will require new 
implementation efforts. Better alternatives 
or findings that dispute the efficacy of 
existing practices should also result in de- 
implementation of less effective or ineffec- 
tive practices. Researchers and clinicians 
alike should embrace and accept a dynamic 
process of continuous discovery that is 
empirically based. Yet, this special issue 
helps us understand that knowledge of 
evidence-based practices is not sufficient. 

The authors of articles in this issue stress 
the need to focus on how we get clinicians 
and the agencies responsible for service 
delivery to implement evidence-based prac- 
tices. New skill sets are needed if we are to 
mobilize enlightened researchers and 
stakeholders who can nurture productive 


partnerships and are equipped to navigate 
the complex steps in the implementation 
process. For example, incorporating prag- 
matic and hybrid designs and expanding 
our use of mixed methods discussed by 
Schliep et al. represent new paradigms for 
advancing knowledge generation for effi- 
cacy and implementation concurrently. 
Incorporating research on implementation 
as early as possible into the intervention 
development and evaluation process holds 
tremendous promise. Research-stakeholder 
partnerships (as discussed by Olswang and 
Goldstein) and approaches to identifying 
successful implementation strategies used 
in combination (as discussed by Campbell 
and Douglas) will change behavior and 
organizations’ expectations. 

We must recognize that there is a great 
deal of heterogeneity in all these systems 
at a local level. However, the scale up of 
evidence-based practices is not restricted to 
small-scale ventures. Indeed, our intention 
is for highly effective and feasible practices 
to be implemented in healthcare and edu- 
cation systems in ways that meet the com- 
munication needs across the globe. It is 
difficult to know how this process will pro- 
ceed, especially if Kincaid and Horner are 
right in arguing that there is “no tipping 
point” when it comes to implementation 
in complex service delivery systems. We 
live in a market economy where there is 
competition and promotion of alternative 
interventions even if existing programs are 
effective. Implementation Science may 
have to address how to keep evidence- 
based practices fresh and marketable from 
a dissemination and implementation stand- 
point. Notably, sustainability should not be 
taken for granted. 

Taken collectively, the articles in this 
special issue present alternatives to the tra- 
ditional research pipeline. The authors 
offer alternative approaches that are meant 
to overcome the persistently long timeline 


60 EBP ADVANCEMENT CORNER: EVIDENCE-BASED PRACTICES AND PROGRAMS 


for research to be assimilated into practice. 
We posit that researchers who consider 
implementation during intervention devel- 
opment will advance science and narrow 
the research to practice gap more quickly. 
We hope that this special issue will provide 
new insights into the future of evidence- 
based communication assessments and 
interventions. These articles make us 
aware of new complexities in conducting 
research that must be addressed for 
researchers to impact the discipline in sig- 
nificant ways. This issue also reveals new 
opportunities for forming exciting collabo- 
rations and partnerships that have the 
potential to make our research better. It is 
our hope that readers will find new inspi- 
ration to advance science and ensure that 
science contributes to solving important 
societal problems more efficiently. 
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NOTES FROM THE EDITORS 


We are grateful to Drs. Howard Goldstein 
and Lesley Olswang who served as Guest 
Editors for this Special Issue on Implemen- 
tation Science. They have recruited an 
excellent group of authors and have 
brought to bear their outstanding scholarly 
and editing skills so that our readership can 
benefit from these contributions in their 
current form. We would also like to express 
our appreciation for each of the authors 
who contributed to the special issue. 
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